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ABSTRACT 



This document contains the results of a standard setting 
conducted in January 2002 on the Delaware Student Testing Program (DSTP) 
Science and Social Studies tests at grades 4 and 6. Each standard setting 
process entailed convening four groups, one for each grade level and content 
area, and each group met for 2 days. At the standard setting judges were 
asked to recommend only the cut point between Below the Standard and Meets 
the Standard, and the cut point between Meets the Standard and Exceeds the 
Standard. Judges were asked only to recommend two of the necessary four cut 
points because the cognitive overload of setting four distinct cuts was too 
much to accomplish in 2 days. The Department of Education used the results to 
calculate the remaining two cut points using the cuts established by the 
judges and the standard error measure to do so. Judges were asked to think of 
the cut point between Meets the Standard and Below the Standard as the line 
that delineates students whose performance is good enough from those who 
might need additional help. This distinction is important because it differs 
from a cut point that might distinguish failing from passing students. Five 
appendixes contain information about the judges, a data comparison with the 
previous year, disaggregations of data, and a survey of standard setting 
participants. (Contains 6 figures and 13 tables.) (SLD) 
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Note about the test data included in this 
document: 

A ll test data included in this document indicated as being from 2000 are from 
the 2000 fall administration of the Delaware Student Testing Program. The 
data from 2000 are complete and may be considered final. 

All test data in this document indicated as being from 2001 are from the 2001 fall 
administration of the Delaware Student Testing Program. The data are to be 
considered preliminary in that the final quality control procedures have not yet 
been applied. Thus all 2001 data herein are subject to change prior to final release. 
However, it is highly unlikely that any significant changes will occur. Furthermore, 
it is unlikely that the percentage of students falling into a particular proficiency 
level will differ from what is indicated here. 

Finally, many of the numbers (from both 2000 and 2001 data) have been rounded 
to make the document more user-friendly. This should be noted when dealing with 
percentages, since not all of them will total 100% as a result of rounding 
anomalies. Also, the number of students may be affected as well. 
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DSTP Proficiency Levels 



1 . Overview 



T his document contains the results of a Standard Setting conducted between January 14, 2002 
and January 17, 2002, on the Delaware Student Testing Program (DSTP) Science and Social 
Studies tests at grades 4 and 6. 

The standard setting process entailed convening four groups — one for each grade level and content 
area. Each group met for two days. Invitations for nominations to serve on the standard setting 
committees were sent to all district superintendents and charter school administrators; then 
Delaware Congress of Parents and Teachers; Delaware Association of School Administrators; 
Delaware State Parent Advisory Council; Delaware State Education Association; Delaware School 
Boards Association; Governor’s Advisory Council for Exceptional Citizens; Parent Information 
Center of Delaware, Inc.; Governor’s Council on Hispanic Affairs; Business/Public Education 
Council; Business/Industry/Education (BIE) Alliance; Delaware State Chamber of Commerce; 
NAACP; and the Metropolitan Wilmington Urban League. Appendix B, page 19, contains copies 
of the invitations, nomination form and a summary of demographic information on the judges as 
well as a listing of who participated in the standard setting sessions. 

Delaware statute requires that the State produce an assessment in each of these content areas and 
establish five levels of proficiency for each test. The proficiency levels are described as follows: 

Table 1: DSTP Proficiency Levels 



Level 


Category 


Description 


5 


Distinguished 


Excellent 

performance 


4 


Exceeds the 
Standard 


Very good 
performance 


3 


Meets the 
Standard 


Good 

performance 


2 


Below the 
Standard 


Needs 

improvement 


1 


Well Below 
the Standard 


Needs lots of 
improvement 




At the Standard Setting, judges were asked to recommend only the cut point between Below the 
Standard and Meets the Standard, and the cut point between Meets the Standard and Exceeds the 
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DSTP Proficiency Levels 



Standard. These two cut points are deemed to be the most important since they define the range of 
scores students can achieve in order to Meet the Standard. It was determined to have the judges 
recommend only two of the necessary four cut points since the cognitive overload of setting four 
distinct cuts was simply too much forjudges to accomplish in a two-day session. The Department 
of Education then used the results to calculate the remaining two cut points using the cuts 
established by the judges and the standard error measure to do so. 

Also at the Standard Setting, judges were specifically told to think of the cut point between 
Meets the Standard and Below the Standard as the line that delineates students whose 
performance is “good enough” from those students who might need some additional instruction 
and/or time to do so. This distinction is important because it differs dramatically from what a cut 
point that delineates “failing” students from “passing” students might look like. Had we asked 
the judges for a pass/fail cut point it is our sense that the standard setting would have produced a 
different result. 

Next Steps 

O nce the State Board of Education approves a set of cut points for the Science and Social 
Studies tests at grades 4 and 6, the results will be applied to the fall 2001 test scores which 
will then be released to students and schools. In addition, the cut points will be traced back on to 
the fall 2000 data. 

Beginning in 2003, the resulting cut points for science and social studies will be used in the 
calculation of the baseline School Composite Scores along with scores for reading, writing, and 
mathematics. 
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